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DETAILED ACTION 

Continued Examination Under 37 CFR LI 14 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 
CFR 1.17(e), was filed in this application after final rejection. Since this appUcation is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 
1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn 
pursuant to 37 CFR 1.114. Applicant's submission filed on 12/15/05 has been entered. 

2. Apphcanf s arguments with respect to claims 1-20 filed on 12/15/05 have been considered 
but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 (JSC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 1 02 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 1-16, 18 and 19 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Acharya et al. U.S. Patent 6,108,453 in view of Kamei et al. U.S. Patent 5,528,698. 

Referring to claim 1, the Acharya reference discloses in Figures 1, 5 and 7, an image 
processing method comprising: capturing a raw image (camera 730 obtains a raw images, see 
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CoL4, lines 65-67); and providing edge enhancements to increase edge detail of the captured 
raw image as part of a demosaicing process (e.g., performing image edge enhancements on 
the captured raw image prior to forming full color pixels through color interpolation as part 
of a demosaicing process, see Col. 5, lines 5-16, lines 64-67 and Col. 6, lines 1-7; the 
Enhanced image 510 as shown in Figure 5 with better detail, such as sharper edges and less 
noise, see Col. 4, lines 20-25, and Col. 6, lines 12-13). However, the Acharya reference does 
not explicitly show using a brightness map of the captured raw image for edge 
enhancements, wherein the brightness map comprises luminance values extracted from the 
captured raw image. 

The Kamei reference teaches in Figures 3 and 6, an image processing method 
comprising: using a brightness map (intensity map) of the captured raw image for edge 
enhancements (See Col. 6, lines 14-19), wherein the brightness map comprises luminance 
values (gray scale values) extracted from the captured raw image (e.g., translates captured 
raw image into a gray scale image or a histogram of pixel intensity, See Col. 5, lines 28-30 
and Col. 9, lines 24-25). The Kamei reference is evidence that one of ordinary skill in the art 
at the time to see more advantages image processing method using a brightness map of the 
captured raw image for edge enhancements, wherein the brightness map comprises 
luminance values extracted from the captured raw image so that the edges are distinguished, 
and the angles of the edges are determined more accurately and easily (See Col. 5, lines 49- 
62). For that reason, it would have been obvious to one of ordinary skill in the art at the time 
of invention to modify the image processing method of Acharya ('453) by using a brightness 
map of the captured raw image for edge enhancements, wherein the brightness map 
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comprises luminance values extracted from the captured raw image as taught by Kamei 
C698). 

Referring to claim 2, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 1, and the Acharya reference discloses performing post 
demosaicing processing on the captured raw image (e.g., the color interpolation processing, 
noise removal or other image enhancement processing are considered as post demosaicing 
processing in the image processing circuit 732, see Col. 9-35); and outputting the processed 
image to display devices (720). 

Referring to claim 3, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 1, the Kamei reference discloses wherein providing the edge 
enhancements includes: creating a brightness map of the captured raw image (e.g., the image 
processing method of Kamei creating 256 gray scale image or a histogram of intensity of 
image; and the Acharya reference also discloses the pre-enhancement map 330 of the 
captured raw image contains the pixel intensity values considered as a brightness map, see 
Col. 4, lines 1-4). 

Referring to claim 4, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 3, and the Acharya reference discloses wherein providing the 
edge enhancements further includes: detecting edges of the captured raw image using the 
brightness map (e.g.. See Kamei's Col. 6, lines 14-19); creating a mask image (approximated 
image 320) form the edge detected brightness map (See Col. 3, lines 60-67); and performing 
unsharp edge enhancement from the masked image (e.g., due to the effectiveness of the 
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smoothing performed as unsharp edge enhancement, the approximated image is sHghtly 
blurred, the edge definition will not be as great as the raw imager 310). 

Referring to claim 5, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 4, and the Acharya reference discloses wherein providing the 
edge enhancements further includes: blending multiplicatively the unsharp edge enhanced 
image (approximated image 320) with the brightness map (410) as shown in Figure 5. 

Referring to claim 6, the Acharya reference discloses in Figures 1, 5 and 7, an apparatus 
comprising: an image capturing device capturing a raw image (camera 730 obtains a raw 
images, see Col.4, lines 65-67); and a processor (processor 712, see Col. 5, lines 55-62) to 
provide edge enhancements to increase edge detail of the captured raw image as part of a 
demosaicing process (e.g., performing image edge enhancements on the captured raw image 
prior to forming full color pixels through color interpolation as part of a demosaicing 
process, see Col. 5, lines 5-16, lines 64-67 and Col. 6, lines 1-7; the Enhanced image 510 as 
shown in Figure 5 with better detail, such as sharper edges and less noise, see Col. 4, lines 
20-25, and Col. 6, lines 12-13). However, the Acharya reference does not explicitly show 
using a brightness map of the captured raw image for edge enhancements, wherein the 
brightness map comprises luminance values extracted fi-om the captured raw image. 

The Kamei reference teaches in Figures 3 and 6, an image processing method 
comprising: using a brightness map (intensity map) of the captured raw image for edge 
enhancements (See Col. 6, lines 14-19), wherein the brightness map comprises luminance 
values (gray scale values) extracted from the captured raw image (e.g., translates captured 
raw image into a gray scale image or a histogram of pixel intensity, See Col. 5, lines 28-30 
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and Col. 9, lines 24-25). The Kamei reference is evidence that one of ordinary skill in the art 
at the time to see more advantages image processing method using a brightness map of the 
captured raw image for edge enhancements, wherein the brightness map comprises 
luminance values extracted from the captured raw image so that the edges are distinguished, 
and the angles of the edges are determined more accurately and easily (See Col. 5, lines 49- 
62). For that reason, it would have been obvious to one of ordinary skill in the art at the time 
of invention to modify the image processing method of Acharya ('453) by using a brightness 
map of the captured raw image for edge enhancements, wherein the brightness map 
comprises luminance values extracted from the captured raw image as taught by Kamei 
C698). 

Referring to claim 7, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 2 and 6. 

Referring to claim 8, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 3 and 6. 

Referring to claim 9, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 4 and 8. 

Referring to claim 10, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 5 and 9. 

Referring to claim 1 1, the Acharya reference discloses in Figures 1, 5 and 7, a machine- 
readable medium (RAM 711, see Col. 5, lines 20-30) that provides instructions, which if 
executed by a processor (processor 712, see CoL 5, lines 55-62), cause the processor to 
perform the operations comprising: capturing a raw image (camera 730 obtains a raw images, 
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see Col.4, lines 65-67); and providing edge enhancements to increase edge detail of the 
captured raw image as part of a demosaicing process (e.g., performing image edge 
enhancements on the captured raw image prior to forming full color pixels through color 
interpolation as part of a demosaicing process, see Col. 5, lines 5-16, lines 64-67 and Col. 6, 
lines 1-7; the Enhanced image 510 as shown in Figure 5 with better detail, such as sharper 
edges and less noise, see Col. 4, lines 20-25, and Col. 6, lines 12-13). However, the Acharya 
reference does not explicitly show using a brightness map of the captured raw image for edge 
enhancements, wherein the brightness map comprises luminance values extracted from the 
captured raw image. 

The Kamei reference teaches in Figures 3 and 6, an image processing method 
comprising: using a brightness map (intensity map) of the captured raw image for edge 
enhancements (See Col. 6, lines 14-19), wherein the brightness map comprises luminance 
values (gray scale values) extracted from the captured raw image (e.g., translates captured 
raw image into a gray scale image or a histogram of pixel intensity, See Col. 5, lines 28-30 
and Col. 9, lines 24-25). The Kamei reference is evidence that one of ordinary skill in the art 
at the time to see more advantages image processing method using a brightness map of the 
captured raw image for edge enhancements, wherein the brightness map comprises 
luminance values extracted from the captured raw image so that the edges are distinguished, 
and the angles of the edges are determined more accurately and easily (See Col. 5, lines 49- 
62). For that reason, it would have been obvious to one of ordinary skill in the art at the time 
of invention to modify the image processing method of Acharya ('453) by using a brightness 
map of the captured raw image for edge enhancements, wherein the brightness map 
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comprises luminance values extracted from the captured raw image as taught by Kamei 
C698). 

Referring to claim 12, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 2 and 11. 

Referring to claim 13, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same conmient as with claims 3 and 11. 

Referring to claim 14, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 4 and 11. 

Referring to claim 15, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 5 and 11. 

Referring to claim 16, the Acharya reference discloses in Figures 1, 5 and 7, an image 
processing device comprising: an image capturing device capturing a raw image (camera 730 
obtains a raw images, see Col.4, lines 65-67); a memory device (disk 718, or memory 711, 
see Col. 5, lines 10-11, lines 55-57 and lines 63-64) to store the captured raw image; an 
output unit (display device 720 and adapter 716) coupled to the memory device as shown in 
Figure 7; and a processor (processor 712, see Col. 5, lines 55-62) to provide edge 
enhancements to increase edge detail of the captured raw image as part of a demosaicing 
process and to cause the enhanced image to be output is to the output unit (e.g., performing 
image edge enhancements on the captured raw image prior to forming full color pixels 
through color interpolation as part of a demosaicing process, see Col. 5, Unes 5-16, lines 64- 
67 and Col. 6, lines 1-7; the Enhanced image 510 as shown in Figure 5 with better detail, 
such as sharper edges and less noise, see Col. 4, lines 20-25, and Col. 6, lines 12-13; and the 
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enhanced image output to the display devices 720 and 716). However, the Acharya reference 
does not explicitly show using a brightness map of the captured raw image for edge 
enhancements, wherein the brightness map comprises luminance values extracted from the 
captured raw image. 

The Kamei reference teaches in Figures 3 and 6, an image processing method 
comprising: using a brightness map (intensity map) of the captured raw image for edge 
enhancements (See Col. 6, lines 14-19), wherein the brightness map comprises luminance 
values (gray scale values) extracted from the captured raw image (e.g., translates captured 
raw image into a gray scale image or a histogram of pixel intensity, See Col. 5, lines 28-30 
and Col. 9, lines 24-25). The Kamei reference is evidence that one of ordinary skill in the art 
at the time to see more advantages image processing method using a brightness map of the 
captured raw image for edge enhancements, wherein the brightness map comprises 
luminance values extracted from the captured raw image so that the edges are distinguished, 
and the angles of the edges are determined more accurately and easily (See Col. 5, lines 49- 
62). For that reason, it would have been obvious to one of ordinary skill in the art at the time 
of invention to modify the image processing method of Acharya ('453) by using a brightness 
map of the captured raw image for edge enhancements, wherein the brightness map 
comprises luminance values extracted from the captured raw image as taught by Kamei 
C698). 

Referring to claim 18, the Acharya and Kamei references disclose wherein the output unit 
is a display device (monitor 720) as shown in Figure 7. 
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Referring to claim 19, the Acharya and Kamei references disclose wherein the processor 
(712) is to perform post demosaicing processing (the color interpolation processing) on the 
captured raw image and to cause the image to be output to the display (720) (See Col. 6, lines 
9-18). 

5. Claims 17 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over Acharya et 
al. U.S. Patent 6,108,453 in view of Kamei et al. U.S. Patent 5,528,698 and Lathrop et al. 
U.S. Patent 6,288,743. 

Referring to claim 17, the Acharya and Kamei references disclose all subject riiatter as 
discussed in respected claim 16, and the Acharya reference discloses the camera (730) is a 
digital camera for capturing a sensor image of an object or scene (See Col. 4, lines 58-60). 
However the Acharya reference does not explicitly states the camera includes a CCD array. 

The Lathrop reference discloses in Figure 1, a digital camera (10, See Col. 3, lines 5-32) 
comprising: a image sensor (CCD 16). The Lathrop reference is evidence that the digital 
camera using CCD as a image sensor to capture a image of an object or scene which is well 
known to one of ordinary skill in the art at the time the invention made so that captured 
image data can be easily digitized and stored in ma non- volatile image memory (See Col. 1, 
lines 10-15). For that reason, it would have been obvious to one of ordinary skill in the art to 
see the digital camera (730) including a CCD array sensor disclosed by Acharya. 

Referring to claim 20, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 19, except the Acharya reference does not explicitly states the 
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other image enhancement processing executed after color interpolation as the post 
demosaicing processing is a white balancing processing. 

The Lathrop reference discloses an imaging apparatus (digital camera 10) has a 
demosaicing processing (interpolate the Bayer pattem digital image data); and a post 
demosaicing processing (white balance, see Col. 3, lines 50-55) for a white balancing 
processing. The Lathrop reference is evidence that one of ordinary skill in the art at the time 
to see more advantages the post demosaicing processing is a white balancing or other image 
processing so that the scene illumination can be estimate more accurately. For that reason, it 
would have been obvious to one of ordinary skill in the art to see the post demosaicing 
processing is a white balancing processing disclosed by Acharya. 

Conclusion 

6. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Lin Ye whose telephone number is (571) 272-7372. The examiner can 
normally be reached on Mon-Fri 8:00AM-5:00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David L. Ometz can be reached on (571) 272-7593. The fax phone number for 
the organization where this appUcation or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application hiformation Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status information 
for unpublished applications is available through Private PAIR only. For more information 
about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access 
to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 
(toll-free). 
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Examiner 
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